Automatic color composition detection for laundry washing machine

ABSTRACT

A laundry washing machine and method automate the selection of one or more parameters of a wash cycle of a laundry washing machine based in part on a color detection sensor disposed proximate an opening of the wash tub and configured to capture color composition data of one or more items added to the wash tub and a weight sensor operatively coupled to the wash tub, where the weight sensor is configured to detect the addition of an item among the one or more items to the wash tub and initiate capturing of the color composition data, and a controller is configured to configure one or more parameters for a wash cycle based upon the captured color composition data.

BACKGROUND

Laundry washing machines are used in many single-family and multi-familyresidential applications to clean clothes and other fabric items. Due tothe wide variety of items that may need to be cleaned by a laundrywashing machine, many laundry washing machines provide a wide variety ofuser-configurable settings to control various aspects of a wash cyclesuch as water temperatures and/or amounts, agitation, soaking, rinsing,spinning, etc. The cycle settings can have an appreciable effect onwashing performance, as well as on energy and/or water consumption, soit is generally desirable for the settings used by a laundry washingmachine to appropriately match the needs of each load washed by themachine.

Some laundry washing machines also support user selection of load types,typically based on the types of fabrics and/or items in the load. Somelaundry washing machines, for example, have load type settings such ascolors, whites, delicates, cottons, permanent press, towels, bedding,heavily soiled items, etc. These manually-selectable load typesgenerally represent specific combinations of settings that are optimizedfor particular load types so that a user is not required to selectindividual values for each of the controllable settings of a laundrywashing machine.

While manual load type selection in many cases simplifies a user'sinteraction with a laundry washing machine, such manual selection stillcan lead to suboptimal performance due to, for example, userinattentiveness or lack of understanding. Therefore, a significant needcontinues to exist in the art for a manner of optimizing the performanceof a laundry washing machine for different types of loads, as well asreducing the burden on users when interacting with a laundry washingmachine.

SUMMARY

The invention addresses these and other problems associated with the artby providing a laundry washing machine and method that automate theselection of one or more parameters for a wash cycle of a laundrywashing machine based in part on color composition of the items to beadded to the washing machine as determined by a color detection sensor.

In some instances, a laundry washing machine is disclosed, the laundrywashing machine including: a wash tub disposed within a housing; a colordetection sensor disposed proximate an opening of the wash tub andconfigured to capture color composition data of one or more items addedto the wash tub; a weight sensor operatively coupled to the wash tub;and a controller coupled to the color detection sensor and the weightsensor and configured to detect an addition of an item among the one ormore items to the wash tub with the weight sensor and initiate capturingof the color composition data with the color detection sensor responsivethereto, where the controller is further configured to configure one ormore parameters for a wash cycle based upon the captured colorcomposition data.

In some embodiments, the color detection sensor may comprise an imagesensor configured to capture an image in response to changes in weightsensed by the weight sensor as additional items are added to the washtub. In other embodiments, the color detection sensor may comprise animage sensor, and where the controller is configured to cause the imagesensor to sequentially capture a plurality of images in response tochanges in weight sensed by the weight sensor as additional items areadded to the wash tub.

In some embodiments, the laundry washing machine may further include aretractable cover configured to selectively cover the color detectionsensor. In other embodiments, the controller may be configured toinitiate automatic retraction of the retractable cover in response toopening of a door that covers an opening of the wash tub, and triggerautomatic closing of the retractable cover in response to closing of thedoor.

In some embodiments, the captured color composition data may include oneor more images, and where the controller is further configured to detecta stain on an item among the one or more items added to the wash tubfrom the one or more images. In some embodiments, the controller may befurther configured to recommend use of a stain removal tool to a user inresponse to detecting the stain. In other embodiments, the controllermay be further configured to configure one or more parameters for thewash cycle in response to detecting the stain. In still otherembodiments, the controller may be further configured to identify one ormore characteristics of the stain detected and configure one or moreparameters for the wash cycle in response to the identified one or morecharacteristics.

In some embodiments, the controller may be configured to select a loadtype from among a plurality of load types based upon the captured colorcomposition data.

In some embodiments, the one or more parameters may include a wash orrinse temperature, a wash or rinse water amount, an agitation duration,an agitation stroke, a soak duration, a spin speed, a spin duration, acycle time, or a number of phase repeats.

In some instances an apparatus is disclose, the apparatus including: animage sensor disposed on a mobile computing device and configured tocapture one or more images of one or more items to be washed by alaundry washing machine; and a controller in communication with theimage sensor and configured to process the one or more images todetermine color composition data from the one or more images of the oneor more items, the controller further configured to configure one ormore parameters for a wash cycle of the laundry washing machine basedupon the color composition data.

In some embodiments, the controller may be further configured to detecta stain on an item among the one or more items from the one or moreimages. In some embodiments, the controller may be further configured torecommend use of a stain removal tool to a user in response to detectingthe stain. In other embodiments, the controller may be configured toconfigure one or more parameters for the wash cycle in response todetecting the stain. In still other embodiments, the controller may beconfigured to identify one or more characteristics of the stain sensedby the color detection sensor and configure the one or more parametersfor the wash cycle in response to the one or more characteristicsidentified.

In some embodiments, the controller may be configured to select a loadtype from among a plurality of load types based upon the colorcomposition data. In other embodiments, the one or more parameters mayinclude a wash or rinse temperature, a wash or rinse water amount, anagitation duration, an agitation stroke, a soak duration, a spin speed,a spin duration, a cycle time, or a number of phase repeats.

In some embodiments, the controller may comprise a processor of themobile computing device. In other embodiments, the controller may bedisposed within the laundry washing machine. In still other embodiments,the controller may be external to and in communication with both thelaundry washing machine and the mobile computing device.

In some instances, a laundry washing machine is disclosed, the laundrywashing machine including: a wash tub disposed within a housing; a colordetection sensor disposed proximate an opening of the wash tub andconfigured to capture color composition data of an item added to thewash tub; and a controller coupled to the color detection sensor andconfigured to detect a stain on the item added to the wash tub, wherethe controller is configured to configure one or more parameters for awash cycle based on the stain detected.

In some embodiments, the controller may be configured to identify one ormore characteristics of the stain sensed by the color detection sensor.In other embodiments, the controller may be further configured torecommend use of a stain removal tool to a user based on the one or morecharacteristics of the stain sensed by the color detection sensor. Instill other embodiments, the one or more parameters may include a washor rinse temperature, a wash or rinse water amount, an agitationduration, an agitation stroke, a soak duration, a spin speed, a spinduration, a cycle time, or a number of phase repeats.

In some instances, a laundry washing machine is disclosed, the laundrywashing machine including: a wash tub disposed within a housing; a colordetection sensor disposed proximate an opening of the wash tub andconfigured to capture color composition data of an item added to thewash tub; a retractable cover configured to selectively cover the colordetection sensor; and a controller coupled to the color detection sensorand the retractable cover configured to initiate automatic retraction ofthe retractable cover in response to opening of a door that covers anopening of the wash tub and initiate capturing of the color compositiondata with the color detection sensor, where controller is furtherconfigured to configure one or more parameters for a wash cycle basedupon the captured color composition data.

In some embodiments, the controller may be configured to initiateautomatic closing of the retractable cover in response to closing of thedoor.

In some instances, a method of operating a laundry washing machineincluding a wash tub disposed within a housing, the method including:detecting weight of one or more items in the wash tub by a weight sensoroperatively coupled to the wash tub; initiating, based on weightdetection, capturing color composition data of the one or more itemsadded to the wash tub by a color detection sensor; detecting a colorcomposition of the one or more items added to the wash tub based on thecolor composition data captured by the color detection sensor; andconfiguring one or more parameters for a wash cycle based upon the colorcomposition.

In embodiments, the color detection sensor may further comprise a cameradisposed within the wash tub and a retractable cover covering thecamera.

In some embodiments, the method may further comprise initiatingautomatic retraction of a retractable cover in response to opening of adoor that covers an opening of the wash tub, and triggering automaticclosing of the retractable cover in response to closing of the door.

In some embodiments, the method may further comprise detecting a stainon the one or more items added to the wash tub from the colorcomposition data captured by the color detection sensor. In otherembodiments, the method may further comprise identifying one or morecharacteristics of the stain detected. In still other embodiments, themethod may further comprise recommending use of a stain removal tool toa user based on the identified characteristics of the stain. In someembodiments, the method may further comprise configuring one or moreparameters for the wash cycle in response to detecting the stain.

In some instances, a method of operating a laundry washing machine isdisclosed, the method including: receiving, in a controller, one or moreimages of one or more items to be washed by the laundry washing machineand captured by an image sensor disposed on a mobile computing device;processing the one or more images with the controller to determine colorcomposition data from the one or more images; and configuring one ormore parameters for a wash cycle of the laundry washing machine basedupon the color composition data.

In some embodiments, the method may further comprise processing the oneor more images with the controller to detect a stain on the one or moreitems to be washed by the laundry washing machine from the one or moreimages. In some embodiments, the method may further comprise identifyingwith the controller one or more characteristics of the stain detected.In other embodiments, the method may further comprise recommending, bythe controller, use of a stain removal tool based on the one or morecharacteristic detected. In still other embodiments, the method mayfurther comprise configuring one or more parameters for the wash cyclein response to detecting the stain.

In some instances, a method of operating a laundry washing machineincluding a wash tub disposed within a housing is disclosed, the methodincluding: capturing color composition data of one or more items addedto the wash tub by a color detection sensor; detecting a stain on theone or more items added to the wash tub based on the color compositiondata; and configuring one or more parameters for a wash cycle inresponse to detecting the stain.

In some embodiments, the method may further comprise recommending use ofa stain removal tool to a user in response to detecting the stain. Insome embodiments, the method may further comprise identifying one ormore characteristics of the stain detected.

In some instances, a method of operating a laundry washing machineincluding a wash tub disposed within a housing is disclosed, the methodincluding: initiating automatic retraction of a retractable coverconfigured to selectively cover a color detection sensor in response toopening of a door that covers an opening of the wash tub; capturingcolor composition data of one or more items added to the wash tub by thecolor detection sensor; detecting a color composition of the one or moreitems added to the wash tub based on the color composition data capturedby the color detection sensor; and configuring one or more parametersfor a wash cycle based upon the color composition data.

In some embodiments, the method may further comprise initiatingautomatic closing of the retractable cover in response to closing of thedoor.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view of a top-load laundry washing machineconsistent with some embodiments of the invention.

FIG. 2 is a perspective view of a front-load laundry washing machineconsistent with some embodiments of the invention.

FIG. 3A is a functional vertical section of the laundry washing machineof FIG. 1.

FIG. 3B is a top perspective view of a laundry washing machine top forthe laundry washing machine of FIG. 1.

FIG. 4 is a block diagram of an example control system for the laundrywashing machine of FIG. 1.

FIG. 5 is a flowchart illustrating an example sequence of operations foroperating the laundry washing machine of FIG. 1.

FIG. 6 is a flowchart illustrating another example sequence ofoperations for operating the laundry washing machine of FIG. 1.

FIG. 7 is a flowchart illustrating another example sequence ofoperations for operating the laundry washing machine of FIG. 1.

FIG. 8 is a flowchart illustrating another example sequence ofoperations for operating the laundry washing machine of FIG. 1.

DETAILED DESCRIPTION

Embodiments consistent with the invention may be used to automate theselection of a one or more parameters for a wash cycle of a laundrywashing machine. In particular, in some embodiments consistent with theinvention, a laundry washing machine may include in part a colordetection sensor located proximate the opening of the wash tub andconfigured to capture color composition data of an item(s) added to thewash tub, a weight sensor operatively coupled to a wash tub, and acontroller configured to detect the addition of an item(s) to the washtub, to initiate the capturing of color composition data by the colordetection sensor, and to configure one or more parameters for a washcycle based on the captured color composition data. In other embodimentsconsistent with the invention, an apparatus may include an image sensorwhich may be located on a mobile computing device and configured tocapture an image(s) of one or more items to be added to the wash tub anda controller in communication with the image sensor that may beconfigured to process the image(s) in order to determine the colorcomposition of the one or more items to be washed and may be configuredto determine one or more parameters of the wash cycle based on the colorcomposition. In still other embodiments, as will become more apparentbelow, the color composition sensor may also be configured to detect astain on the one or more items to be washed.

A parameter for a wash cycle, in this regard, may include any number ofdifferent configurable aspects of a wash cycle performed by a laundrywashing machine including, but not limited to, a wash water temperature,a rinse water temperature, a wash water amount, a rinse water amount, aspeed or stroke of agitation during washing and/or rinsing, a spinspeed, whether or not agitation is used during washing and/or rinsing, aduration of a wash, rinse, soak, or spin phase of a wash cycle, a numberof repeats of a wash, rinse, soak or spin phase, selection betweendifferent rinse operation types such as a spray rinse operation or adeep fill rinse operation, pre-treatment such as soaking over time witha prescribed water temperature and specific agitation stroke, etc. Insome embodiments, either a user selection or automated selection of aload type (e.g. delicates, colors or whites, or the like) may result inthe selection of one or more parameters corresponding to a wash cycleconfigured for that load type.

Numerous variations and modifications will be apparent to one ofordinary skill in the art, as will become apparent from the descriptionbelow. Therefore, the invention is not limited to the specificimplementations discussed herein.

Turning now to the drawings, wherein like numbers denote like partsthroughout the several views, FIG. 1 illustrates an example laundrywashing machine 10 in which the various technologies and techniquesdescribed herein may be implemented. Laundry washing machine 10 is atop-load washing machine, and as such includes a top-mounted door 12 ina cabinet or housing 14 that provides access to a vertically-orientedwash tub 16 housed within the cabinet or housing 14. Door 12 isgenerally hinged along a side or rear edge and is pivotable between theclosed position illustrated in FIG. 1 and an opened position (notshown). When door 12 is in the opened position, clothes and otherwashable items may be inserted into and removed from wash tub 16 throughan opening in the top of cabinet or housing 14. Control over washingmachine 10 by a user is generally managed through a control panel 18disposed on a backsplash and implementing a user interface for thewashing machine, and it will be appreciated that in different washingmachine designs, control panel 18 may include various types of inputand/or output devices, including various knobs, buttons, lights,switches, textual and/or graphical displays, touch screens, etc. throughwhich a user may configure one or more settings and start and stop awash cycle.

The embodiments discussed hereinafter will focus on the implementationof the hereinafter-described techniques within a top-load residentiallaundry washing machine such as laundry washing machine 10, such as thetype that may be used in single-family or multi-family dwellings, or inother similar applications. However, it will be appreciated that theherein-described techniques may also be used in connection with othertypes of laundry washing machines in some embodiments. For example, theherein-described techniques may be used in commercial applications insome embodiments. Moreover, the herein-described techniques may be usedin connection with other laundry washing machine configurations. FIG. 2,for example, illustrates a front-load laundry washing machine 20 thatincludes a front-mounted door 22 in a cabinet or housing 24 thatprovides access to a horizontally-oriented wash tub 26 housed within thecabinet or housing 24, and that has a control panel 28 positionedtowards the front of the machine rather than the rear of the machine asis typically the case with a top-load laundry washing machine.Implementation of the herein-described techniques within a front-loadlaundry washing machine would be well within the abilities of one ofordinary skill in the art having the benefit of the instant disclosure,so the invention is not limited to the top-load implementation discussedfurther herein.

FIG. 3A functionally illustrates a number of components in laundrywashing machine 10 as is typical of many washing machine designs. Forexample, wash tub 16 may be vertically oriented, generally cylindricalin shape, opened to the top and capable of retaining water and/or washliquor dispensed into the washing machine. Wash tub 16 may be supportedby a suspension system such as a set of support rods 30 withcorresponding vibration dampening springs 32.

Disposed within wash tub 16 is a wash basket 34 that is rotatable abouta generally vertical axis A by a drive system 36. Wash basket 34 isgenerally perforated or otherwise provides fluid communication betweenan interior 38 of the wash basket 34 and a space 40 between wash basket34 and wash tub 16. Drive system 36 may include, for example, anelectric motor and a transmission and/or clutch for selectively rotatingthe wash basket 34. In some embodiments, drive system 36 may be a directdrive system, whereas in other embodiments, a belt or chain drive systemmay be used.

In addition, in some embodiments an agitator 42 such as an impeller,auger or other agitation element may be disposed in the interior 38 ofwash basket 34 to agitate items within wash basket 34 during a washingoperation. Agitator 42 may be driven by drive system 36, e.g., forrotation about the same axis as wash basket 34, and a transmissionand/or clutch within drive system 36 may be used to selectively rotateagitator 42. In other embodiments, separate drive systems may be used torotate wash basket 34 and agitator 42.

A water inlet 44 may be provided to dispense water into wash tub 16. Insome embodiments, for example, hot and cold valves 46, 48 may be coupledto external hot and cold water supplies through hot and cold inlets 50,52, and may output to one or more nozzles 54 to dispense water ofvarying temperatures into wash tub 16. In addition, a pump system 56,e.g., including a pump and an electric motor, may be coupled between alow point, bottom or sump in wash tub 16 and an outlet 58 to dischargegreywater from wash tub 16.

In some embodiments, laundry washing machine 10 may also include adispensing system 60 configured to dispense detergent, fabric softener,stain removing compositions, and/or other wash-related products intowash tub 16. Dispensing system 60 may be configured, in someembodiments, to dispense controlled amounts of wash-related products,e.g., as may be stored in a reservoir (not shown) in laundry washingmachine 10. In other embodiments, dispensing system 60 may be used totime the dispensing of wash-related products that have been manuallyplaced in one or more reservoirs in the machine immediately prior toinitiating a wash cycle. Dispensing system 60 may also, in someembodiments, receive and mix water with wash-related products to formone or more wash liquors that are dispensed into wash tub 16. In stillother embodiments, no dispensing system may be provided, and a user maysimply add wash-related products directly to the wash tub prior toinitiating a wash cycle.

It will be appreciated that the particular components and configurationillustrated in FIG. 3A is typical of a number of common laundry washingmachine designs. Nonetheless, a wide variety of other components andconfigurations are used in other laundry washing machine designs, and itwill be appreciated that the herein-described functionality generallymay be implemented in connection with these other designs, so theinvention is not limited to the particular components and configurationillustrated in FIG. 3A.

Further, in some embodiments, in order to configure one or moreparameters of a wash cycle, laundry washing machine 10 may include atleast a weight sensor and a color detection sensor. A weight sensor maybe used to generate a signal that varies based in part on the mass orweight of the contents of wash tub 16. In the illustrated embodiment,for example, a weight sensor may be implemented in laundry washingmachine 10 using one or more load cells 62 that support wash tub 16 onone or more corresponding support rods 30. Each load cell 62 may be anelectro-mechanical sensor that outputs a signal that varies with adisplacement based on load or weight, and thus outputs a signal thatvaries with the weight of the contents of wash tub 16. Multiple loadcells 62 may be used in some embodiments, while in other embodiments,other types of transducers or sensors that generate a signal that varieswith applied force, e.g., strain gauges, may be used. Furthermore, whileload cells 62 are illustrated as supporting wash tub 16 on support rods30, the load cells, or other appropriate transducers or sensors, may bepositioned elsewhere in a laundry washing machine to generate one ormore signals that vary in response to the weight of the contents of washtub 16. In some embodiments, for example, transducers may be used tosupport an entire load washing machine, e.g., one or more feet of amachine. Other types and/or locations of transducers suitable forgenerating a signal that varies with the weight of the contents of awash tub will be apparent to one of ordinary skill in the art having thebenefit of the instant disclosure. In addition, in some embodiments, aweight sensor may also be used for vibration sensing purposes, e.g., todetect excessive vibrations resulting from an out-of-balance load. Inother embodiments, however, no vibration sensing may be used, while inother embodiments, separate sensors may be used to sense vibrations.

In some instances a color detection sensor 68 may be located proximatean opening of the wash tub 16 and may capture color composition data ofone or more items. In such embodiments, the color detection sensor 68may capture the color composition data as the item(s) are added to thewash tub 16, and thus, as illustrated in FIG. 3B, color detection sensor68 in some embodiments may be generally upwardly facing and disposed ina top part 66 of a cabinet of a top load laundry washing machine, and insome instances may be located underneath of a door to the wash tub (notshown in FIG. 3B). In other embodiments, the color composition sensor 68may be disposed on a mobile computing device, including, but not limitedto, a smart phone, digital camera, smart watch, tablet, or the like. Insuch embodiments, the color composition data may be captured as theitem(s) are added to the wash tub 16, or any time prior to that. Forexample, in some instances, it may be desirable to capture the colorcomposition data as the item(s) become in need of laundering, or as theitem(s) are added to a laundry hamper. Other positions for colordetection sensor 68 may be used in other embodiments, e.g., on a door,directed inwardly into a wash tub, proximate a top edge of a door on afront-load laundry washing machine, and in other locations suitable forcapturing data from items prior to, during, or after loading into a washtub.

In some embodiments, the color detection sensor 68 may be an imagesensor, or a camera. In some embodiments such an image sensor may bedisposed on or in laundry washing machine 10, while in other embodimentssuch an image sensor may be disposed on a mobile computing device. Insuch embodiments, the color composition data may be in the form of animage captured by the image sensor. In other embodiments, colorcomposition data may be an optical reading of the light composition ofthe item(s). In still other embodiments, the color composition data maybe in the form of one or more color models, including, but not limitedto the RGB color model, the CMKY color model, or the like. In suchembodiments, the color composition data may be given a numerical valueto represent the amount of each color (for example, in the RGB colormodel the amount of red, green, and/or blue) captured by the colordetection sensor 68. One or more parameters of the wash cycle may beconfigured based on the color composition data. As a non-limitingexample, where the color composition data indicates the items arebrightly colored (e.g. red, orange, etc.), it may be desirable toutilize cold or cool water in order to minimize the bleeding and/orfading of the colors during the wash cycle.

In some embodiments, the color detection sensor 68 may be initiated inresponse to the weight of one or more items being added to wash tub, assensed by the weight sensor. In other embodiments, the color detectionsensor may sequentially capture (for example through an imagine sensor)color composition data in response to changes in weight detected by theweight sensor as items are added to the wash tub 16. In some instances,for example where there are many items to be washed, such a sequentialcapture of color composition data may be desirable in order to moreaccurately reflect the color composition of all items to be washed.

In some embodiments, the color detection sensor 68 may also be used todetect a stain on the item(s). In some embodiments, stain detection maybe done in conjunction and/or simultaneously with capturing colorcomposition data; while in other embodiments, stain detection and thecapture of color composition data are separate and discrete functions ofthe color detection sensor 68. One or more parameters of the wash cyclemay be configured based on the detection of a stain. As a non-limitingexample, where a stain is detected, it may be desirable to utilize apretreatment, such as a soak, in order to aid in removing the stain. Inother embodiments, one or more characteristics of the detected stain maybe determined, for example composition of the stain (e.g. oil, food,etc.) size of the stain, intensity or the stain, and the like. In stillother embodiments, the use of a stain removal tool may be recommended(e.g., via a notification to a user via a user interface of the laundrywashing machine or a mobile computing device) based on thecharacteristic(s) of the stain. In such embodiments, the stain removingtool may be stored within the laundry washing machine 10, until such atime as its use is recommended. The stain removing tool may then bedeployed from this stored position and may receive at least a portion ofan item containing the stain in order to remove or treat the stain withwater (for example, via nozzles or brushes to spray and/or scrub theitem). In some embodiments, a user may be instructed to present stainson clothing items to the color detection sensor by a user interface, ora user may be permitted to select an option via the user interface toindicate that the user is about to present a stain on a clothing item tothe color detection sensor.

In some embodiments, a retractable cover 70 may selectively cover acolor detection sensor 68 located proximate an opening of the wash tub16, as illustrated in FIGS. 3A and 3B. In some embodiments, asillustrated in FIG. 3B, the color detection sensor 68 and retractablecover 70 may be located as a part of or proximate a top part 66 of thecabinet of laundry washing machine 10. Although illustrated in FIGS. 3Aand 3B as only partially covering the color detection sensor 68 this isfor illustrative purposely only, when in use a retractable cover 70 willgenerally translate between covering and exposing substantially all ofthe color detection sensor 68. In such embodiments, the retractablecover 70 may be configured to initiate automatic retraction in responseto the door 12 covering the wash tub opening. In some embodiments,information from the door switch 82, which detects whether door 12 is inan open or closed position, may be utilized in initiating the automaticretraction of the retractable cover 70. In some instances, particularlywhere the color detection sensor 68 is disposed within the wash tub (asillustrated in FIGS. 3A and 3B), a retractable cover 70 may beparticularly desirable as the color detection sensor 68 may be exposedto the water, detergent, and the like during the wash cycle. Variousretractable cover designs may be used, e.g., slidable planar covers,iris-type covers, pivotable covers, etc.

In some embodiments, information from the door switch 82 may also beutilized in initiating the automatic closing of the retractable cover 70in response to the closing of the door 12.

Although a weight sensor and a color detection sensor 68 arespecifically discussed herein, this is not to be understood as limiting,as additional sensors may also be incorporated into a laundry washingmachine 10. For example, in some embodiments, sensors may be used tomeasure turbidity, conductivity, temperature, and/or other sensors thatmay be incorporated in the laundry washing machine to measure additionalcharacteristics.

Now turning to FIG. 4, laundry washing machine 10 may be under thecontrol of a controller 80 that receives inputs from a number ofcomponents and drives a number of components in response thereto.Controller 80 may, for example, include one or more processors and amemory (not shown) within which may be stored program code for executionby the one or more processors. The memory may be embedded in controller80, but may also be considered to include volatile and/or non-volatilememories, cache memories, flash memories, programmable read-onlymemories, read-only memories, etc., as well as memory storage physicallylocated elsewhere from controller 80, e.g., in a mass storage device oron a remote computer interfaced with controller 80.

As shown in FIG. 4, controller 80 may be interfaced with variouscomponents, including the aforementioned drive system 36, hot/cold inletvalves 46, 48, pump system 56, weight sensor 62, color detection sensor68, and so on. In addition, controller 80 may be interfaced withadditional components such as a door switch 82 that detects whether door12 is in an open or closed position and a door lock 84 that selectivelylocks door 12 in a closed position. Moreover, controller 80 may becoupled to a user interface 86 including various input/output devicessuch as knobs, dials, sliders, switches, buttons, lights, textual and/orgraphics displays, touch screen displays, speakers, image capturedevices, microphones, etc. for receiving input from and communicatingwith a user. In some embodiments, controller 80 may also be coupled toone or more network interfaces 88, e.g., for interfacing with externaldevices via wired and/or wireless networks such as Ethernet, Bluetooth,NFC, cellular and other suitable networks. Additional components mayalso be interfaced with controller 80, as will be appreciated by thoseof ordinary skill having the benefit of the instant disclosure.Moreover, in some embodiments, at least a portion of controller 80 maybe implemented externally from a laundry washing machine, e.g., within amobile device, a cloud computing environment, etc., such that at least aportion of the functionality described herein is implemented within theportion of the controller that is externally implemented.

In some embodiments, controller 80 may operate under the control of anoperating system and may execute or otherwise rely upon various computersoftware applications, components, programs, objects, modules, datastructures, etc. In addition, controller 80 may also incorporatehardware logic to implement some or all of the functionality disclosedherein. Further, in some embodiments, the sequences of operationsperformed by controller 80 to implement the embodiments disclosed hereinmay be implemented using program code including one or more instructionsthat are resident at various times in various memory and storagedevices, and that, when read and executed by one or more hardware-basedprocessors, perform the operations embodying desired functionality.Moreover, in some embodiments, such program code may be distributed as aprogram product in a variety of forms, and that the invention appliesequally regardless of the particular type of computer readable mediaused to actually carry out the distribution, including, for example,non-transitory computer readable storage media. In addition, it will beappreciated that the various operations described herein may becombined, split, reordered, reversed, varied, omitted, parallelizedand/or supplemented with other techniques known in the art, andtherefore, the invention is not limited to the particular sequences ofoperations described herein.

FIG. 4 illustrates an example control system for a laundry washingmachine 10 described herein; however, it is to be understood that thelocation of the controller is not limited to the laundry washing machine10 itself. In some embodiments, the controller may be disposed in amobile computing device, server, or other device wirelessly connected tothe laundry washing machine 10. Moreover, multiple devices, e.g., anembedded device in a laundry washing machine and a device networkedthereto such as a mobile computing device may collectively implement thefunctions of controller 80, with different operations performed by thedifferent devices alone or jointly with one another.

The typical operation of a laundry washing machine 10 includes a userdetermining various parameters for a wash cycle. Now turning to FIG. 5,and with continuing reference to FIGS. 3A, 3B and 4, an embodiment of amethod 100 for operating a laundry washing machine 10 and automaticallyselecting of one or more parameters of the wash cycle based on the colorcomposition of the items to be added to the wash tub is illustrated. Itwill be appreciated that wash cycles may vary in a number of respectsthat may be configured by method 100, or other exemplary methodsdisclosed herein. For example, additional phases, such as a pre-soakphase, may be included in some wash cycles, and moreover, some phasesmay be repeated, e.g., including multiple rinse and/or spin phases. Eachphase may also have a number of different operational settings that maybe varied for different types of loads, e.g., different times ordurations, different water temperatures, different agitation speeds orstrokes, different rinse operation types, different spin speeds,different water amounts, different wash product amounts, etc.

In embodiments consistent with the invention, the operation of a laundrywashing machine may include detecting the weight of one or more items inthe wash tub 102 through use of a weight sensor that is coupled to thewash tub. Next, in block 104 the capture of color composition data ofthe items added to the wash tub by the color detection sensor 68 isinitiated based on weight detection. When one or more items are added tothe wash tub 16 (e.g. a shirt) the weight of the item(s) is detected bythe weight sensor, and may initiate the capture of color compositiondata. In some embodiments, the color detection sensor 68 may furthercontain a camera and/or a retractable cover 70 that covers and protectsthe color detection sensor 68 when not in use; in some instances, thismay be particularly desirable where the color detection sensor 68 iscontained within the wash tub 16 and may be exposed to the water,detergent, and the like during the wash cycle. In such embodiments, theretractable cover 70 may be automatically retracted in response to theopening of the door 12 that covers the wash tub 16, and the retractablecover 70 may automatically close in response to the closing of the door12 that covers the wash tub 16.

In block 106, a color composition of the item(s) added to the wash tubis detected based on the color composition data captured by the colordetection sensor 68. In some embodiments, the color detection sensor 68is configured to sequentially detect color composition data as theweight sensor detects additional items being added to the wash tub 16,this may be desirable where a larger number of items are added to thewash tub and may allow for more accurate data regarding colorcomposition to be gathered. In block 108, one or more parameters of awash cycle may be configured based on the detected color composition ofthe item(s) in the wash tub 16.

In some embodiments, particularly where the color detection sensor 68contains an image sensor, one or more stains may be detected on theitem(s) added to the wash tub by the image(s) taken by the image sensor.Once detected, various characteristics of the stain may be identified.Characteristics may include, but are not limited to, the composition ofthe stain (e.g. oil, food, bodily fluids, etc.), size of the stain,intensity or the stain, and the like. In some embodiments, a particularstain removal tool may be recommended based on the characteristicsdetermined. Such a tool may be stored within the laundry washing machine10 until its use is recommended. At such a time, the tool may bedeployed from its storage position and may include the use of sprayingand/or scrubbing to treat at least a portion of the item with the stain.In other embodiments, the wash cycle may automatically configure certainparameters in response to a stain being detected.

As described previously, a parameter for a wash cycle, in this regard,may include any number of different configurable aspects of a wash cycleperformed by a laundry washing machine including, but not limited to, awash water temperature, a rinse water temperature, a wash water amount,a rinse water amount, a speed or stroke of agitation during washingand/or rinsing, a spin speed, whether or not agitation is used duringwashing and/or rinsing, a duration of a wash, rinse, soak, or spin phaseof a wash cycle, a number of repeats of a wash, rinse, soak or spinphase, selection between different rinse operation types such as a sprayrinse operation or a deep fill rinse operation, pre-treatment such assoaking over time with a prescribed water temperature and specificagitation stroke, etc. In some embodiments, either a user selection orautomated selection of a load type (e.g. delicates, colors or whites, orthe like) may result in the selection of one or more parameterscorresponding to a wash cycle configured for that load type.

FIG. 6 next illustrates another method of operating a laundry washingmachine 200 consistent with the invention. In block 202, a controllerreceives one or more images captured by an image sensor disposed on amobile computing device of one or more items to be washed by a laundrywashing machine. In some embodiments, the controller may disposed withinthe mobile computing device capturing the image(s). In otherembodiments, the controller may be disposed with in the laundry washingmachine 10. In still other embodiments, the controller may be disposedon a server, or other device, in wireless communication with the mobilecomputing device and laundry washing machine 10, and in otherembodiments, multiple devices, e.g., the laundry washing machine and amobile computing device or server, may perform different blocks of FIG.6. In block 204, the image(s) may be processed by the controller todetermine color composition data from the images(s). In block 206, oneor more wash parameters may be configured for a wash cycle of thelaundry washing machine based on the color composition data.

In some embodiments, the images may be taken and processed by thecontroller immediately prior to, or during, being added to the wash tub16. In other embodiments, the images may be captured and stored beforeprocessing; for example, this may allow a user to capture one or moreimages as they are placed in a laundry hamper.

In some embodiments, the controller may further process the image(s) todetect a stain on the item(s) to be washed. Once detected, thecontroller may identify various characteristics of the stain.Characteristics may include, but are not limited to, the composition ofthe stain (e.g. oil, food, etc.) size of the stain, intensity or thestain, and the like. In some embodiments, the controller may recommend aparticular stain removal based on the characteristics of the staindetermined. Such a tool may be stored within the laundry washing machine10 until its use is recommended. At such a time, the tool may bedeployed from its storage position and may include the use of sprayingand/or scrubbing to treat at least a portion of the item with the stain.In other embodiments, the controller may configure one or moreparameters of the wash cycle in response to the detection of a stain.

FIG. 7 next illustrates another method of operating a laundry washingmachine 300 consistent with the invention. In block 302, colorcomposition data of one or more item(s) added to the wash tub 16. Inblock 304, based on the color composition data a stain may be detectedon the item(s) added to the wash tub 16. In block 306 one or moreparameters of the wash cycle may be configured in response to thedetection of the stain. In some embodiments, various characteristics ofthe stain may be identified. Characteristics may include, but are notlimited to, the composition of the stain (e.g. oil, food, etc.) size ofthe stain, intensity or the stain, and the like. In other embodiments, aparticular stain removal may be recommended based on the characteristicsof the stain. Such a tool may be stored within the laundry washingmachine 10 until its use is recommended. At such a time, the tool may bedeployed from its storage position and may include the use of sprayingand/or scrubbing to treat at least a portion of the item with the stain.

Now turning to FIG. 8, an embodiment of a method 400 for operating alaundry washing machine 10 and automatically selecting of one or moreparameters of the wash cycle based on the color composition of the itemsto be added to the wash tub 16 is illustrated. In embodiments consistentwith the invention, the operation of a laundry washing machine 10 mayinclude initiating automatic retraction 302 of a retractable cover 70,where the retractable cover 70 may be configured to selectively cover acolor detection sensor 68. The initiation of the retraction of the cover70 may be in response to the opening of a door 12 that covers the washtub 16. In some embodiments, door switch 82 may provide the necessarysignal that the door 12 has been opened.

Next, in block 404 the capture of color composition data of the itemsadded to the wash tub 16 by the color detection sensor 68 occurs. Inblock 406, a color composition of the item(s) added to the wash tub 16may be detected based on the color composition data captured by thecolor detection sensor 68. In some embodiments, the color detectionsensor 68 may be configured to sequentially detect color compositiondata as the weight sensor detects additional items being added to thewash tub 16, this may be desirable where a larger number of items areadded to the wash tub. In block 408, one or more parameters of a washcycle may be configured based on the detected color composition of theitems in the wash tub 16.

In some embodiments, method 400 may further include the automaticclosing, or retraction, of the cover 70 in response to the door 12covering the wash tub 16 closing. In some embodiments, door switch 82may provide the necessary signal that the door 12 has been closed.

Various additional modifications may be made to the illustratedembodiments consistent with the invention. Therefore, the invention liesin the claims hereinafter appended.

What is claimed is:
 1. An apparatus comprising: an image sensor disposedon a mobile computing device and configured to capture one or moreimages of one or more items to be washed by a laundry washing machine;and a controller in communication with the image sensor and configuredto process the one or more images to determine color composition datafrom the one or more images of the one or more items, the controllerfurther configured to configure one or more parameters for a wash cycleof the laundry washing machine based upon the color composition data. 2.The laundry washing machine of claim 1, wherein the controller isfurther configured to detect a stain on an item among the one or moreitems from the one or more images.
 3. The apparatus of claim 2, whereinthe controller is further configured to recommend use of a stain removaltool to a user in response to detecting the stain.
 4. The apparatus ofclaim 2, wherein the controller is configured to configure one or moreparameters for the wash cycle in response to detecting the stain.
 5. Theapparatus of claim 2, wherein the controller is configured to identifyone or more characteristics of the stain sensed by the color detectionsensor and configure the one or more parameters for the wash cycle inresponse to the one or more characteristics identified.
 6. The apparatusof claim 1, wherein the controller is configured to select a load typefrom among a plurality of load types based upon the color compositiondata.
 7. The apparatus of claim 1, wherein the one or more parametersinclude a wash or rinse temperature, a wash or rinse water amount, anagitation duration, an agitation stroke, a soak duration, a spin speed,a spin duration, a cycle time, or a number of phase repeats.
 8. Theapparatus of claim 1, wherein the controller comprises a processor ofthe mobile computing device.
 9. The apparatus of claim 1, wherein thecontroller is disposed within the laundry washing machine.
 10. Theapparatus of claim 1, wherein the controller is external to and incommunication with both the laundry washing machine and the mobilecomputing device.
 11. A method of operating a laundry washing machine,the method comprising: receiving, in a controller, one or more images ofone or more items to be washed by the laundry washing machine andcaptured by an image sensor disposed on a mobile computing device;processing the one or more images with the controller to determine colorcomposition data from the one or more images; and configuring one ormore parameters for a wash cycle of the laundry washing machine basedupon the color composition data.
 12. The method of claim 11, furthercomprising processing the one or more images with the controller todetect a stain on the one or more items to be washed by the laundrywashing machine from the one or more images.
 13. The method of claim 12,further comprising identifying with the controller one or morecharacteristics of the stain detected.
 14. The method of claim 12,further comprising recommending, by the controller, use of a stainremoval tool based on the one or more characteristics detected.
 15. Themethod of claim 12, further comprising configuring one or moreparameters for the wash cycle in response to detecting the stain.